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Abstract 

This paper further develops work from a previous article which introduced a 
new way of modelling evolutionary game models with an emphasis on ecological 
realism, concerned with how ecological factors determine payoffs in evolution- 
ary games. The current paper is focused on the impact of selectively neutral 
factors (i.e. those that are the same for all strategies), such as background 
fitness and a neutral density dependence on game dynamics. In the previous 
paper background mortality was modelled by post-reproductive mortality de- 
scribing aggregated mortality between game interactions. In this paper a novel 
approach to the modelling of background fitness, based on different occurrence 
rates (intensities) of game interactions and background events is presented. It 
is shown that the new method is more realistic and natural for dynamic models 
than the method used in the previous paper. The previous method in effect 
produces biased trajectories, but it is compatible with the new approach at the 
restpoints. Also in this paper a rigorous stability analysis of the restpoints of 
the dynamics is presented. It is shown that the stability or instability of the 
restpoints, can be explained by a mechanism of eco-evolutionary feedback. The 
results obtained are illustrated by a Hawk-Dove game example. 

keywords: evolutionary game, replicator dynamics, background fitness, den- 
sity dependence 

1 Introduction 

In a previous paper (Argasinski and Broom 2012) a novel approach to evolution- 
ary game modelling was presented. The new approach is focused on ecological 
realism, falsifiability of the models and a mechanistic interpretation of the ob- 
tained results. The main goal was to express individual fitness in terms of the 
demographic parameters. This will allow us to describe the parameters of the 
models, such as "costs" and "benefits", by clear and measurable parameters 
(mortality and fecundity) instead of an abstract, undefined "fitness". This is 
realized by the explicit application of two payoff functions describing the mor- 
tality and the fecundity, instead of one fitness function describing the excess 
from the mean Malthusian growth rate. The new approach can be described as 
"event based" because it describes cause and effect chains of underlying interac- 
tion events. For example mortality can act on adult individuals before or after 
reproduction. An important aspect shown by these results is that some prop- 
erties known from classical evolutionary game theory (Maynard Smith 1982, 
Hofbauer and Sigmund 1988 and 1998) such as the independence of the replica- 
tor dynamics from the background fitness are not satisfied in the new approach. 
The general framework presented in Argasinski and Broom (2012) is illustrated 
by use of a Hawk-Dove game example, a classical application of game theoretic 
methods in evolutionary biology. This example clearly shows that the classical 
Hawk-Dove game which can be found in textbooks is seriously oversimplified. 
This emphasizes the importance of selectively neutral factors (i.e. those that 
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are the same for all strategies), such as background fitness and the impact of 
neutral density dependence in game theoretic models. Both of these aspects 
were present in Argasinski and Broom (2012) but are not rigorously analyzed 
there. They are the subject of this paper. We now present a brief introduction 
to both problems. 

1.1 Background fitness 

Traditionally, background fitness is interpreted as some constant (or function) 
added to the payoffs of all strategies which vanishes from the continuous repli- 
cator equations. This is a transfer of the background payoff concept, from the 
classical game theory to the evolutionary game theory. In Argasinski and Broom 
(2012) this approach was generalized for both mortality and fertility payoffs to 
show how selectively neutral elements (i.e. the same for all strategies) of the 
respective payoff functions act on the overall dynamics. This was realized by 
adding a constant Wb to the fertility function and multiplying by constants 
d and m, respectively, pre- and post-reproductive mortality functions. It was 
shown there that only pre-reproductive mortality can be interpreted as selec- 
tively neutral because it affects only the rate of convergence but does not alter 
the phase portraits of the dynamics. However, the post-reproductive mortality 
m (in the further sections this will be labelled mi to distinguish from the alter- 
native approach) and background fertility Wb affects the form of the replicator 
equations and the game theoretic structure. In addition the Hawk-Dove exam- 
ple has shown that factors described by those parameters can be very important 
for the realism of the models. Without background mortality, individuals die 
only as a result of the game interaction. In the Hawk Dove game this leads to 
the hidden assumption that Doves are immortal, because only Hawks fight and 
suffer mortality due to their injuries. Thus, background mortality parameters 
should be incorporated in the models and this topic is extremely important. In 
the previous paper the mathematical aspects of the inclusion of such param- 
eters were analyzed as the consequences of the generalization of the classical 
approach. However, a question arises on the adequacy of the implemented so- 
lutions, which are a simple extension of the classical theory, from the biological 
point of view. We discuss this topic more in Section 3. The next section contains 
an application of this approach, since density dependent juvenile mortality is an 
example of the multiplicative selectively neutral element of the fertility function. 

1.2 Neutral density dependence as an effect of limitation 
of the population size 

In the classical approach to evolutionary game modelling there is no explicit 
analysis of the impact of limitations of the population size. In more complex 
approaches (Cressman 1992, Cressman et al 2001, Cressman and Garay 2003, 
Argasinski 2006) density dependence was taken into consideration. The specific 
case of selectively neutral density dependence was analyzed in Argasinski and 
Kozlowski (2008). There it was shown that density dependence can act as a 
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juvenile mortality driven by the availability of nest sites where newborns can 
settle (it is described as the logistic suppression coefficient (1 — n/K), where 
K is the carrying capacity). In effect differences in fertility are suppressed. In 
the basic approach to evolutionary games where the payoff function describes 
the "fitness" of different strategies, this mechanism affects only the pace of 
convergence, while the phase portraits remain the same. 

However, in the more realistic approach presented by Argasinski and Broom 
(2012), which this paper is a continuation of, selectively neutral density de- 
pendence has serious consequences, because it affects the impact of differences 
in fertility among different strategies on overall fitness including differences in 
mortality. In that paper it was shown that under the influence of neutral den- 
sity dependence, the behavior of the system is different from that in the model 
with unlimited growth. The main difference is that in the model with unlimited 
growth there are only equations describing the evolution of strategy frequencies, 
while in the density dependent model there is an additional equation describ- 
ing the size of the population and fertilities are affected by juvenile mortality 
described by logistic suppression. In effect, in the density dependent model, 
the stable frequency becomes a function of n describing a stationary manifold. 
In addition, the equation on the population size leads to another stationary 
manifold being the function of the population composition. Thus, the global 
stationary states are intersections of these manifolds, which can be stable or 
unstable. In effect new behaviours can emerge, for example additionally to 
the stable mixed equilibrium, simultaneously a stable pure Hawk solution can 
emerge (Argasinski and Broom, 2012). The additional stable restpoint is caused 
by neutral density dependence. 

This is related to the concept of the stationary density surface (Cressman et 
al 2001, Cressman and Garay 2003), assuming that the population size traces the 
equilibrium value determined by the strategy frequencies. In the case of selec- 
tively neutral density dependence this surface is stable, because it is an outcome 
of the single equation on the population size (Argasinski and Kozlowski 2008, 
Argasinski and Broom 2012). In Argasinski and Broom (2012) the assumption 
of population size equilibrium was used to simplify the system, by substituting 
for the population size with the equilibrium value of the size equation into the 
frequency equations. This assumption is reasonable from the ecological point 
of view, however the role of both manifolds in the dynamics was not rigorously 
analyzed. Therefore, it is not clear if this assumption can be applied in every 
case and if it alters the predictions of the model or if it is just a limitation of the 
analysis to the neighbourhood of the stationary size manifold. In Argasinski and 
Broom (2012) stability analysis of intersections was performed for the simpli- 
fied case of equilibrium size. This question will be analyzed in Section 4 which 
contains a general analysis of system stability and a mechanistic explanation of 
the interplay between the selection equilibrium describing the stable population 
composition and the ecological equilibrium describing the stable population size. 



4 



2 Some important details from the previous pa- 



per 

This section contains some details from Argasinski and Broom (2012) and an 
be skipped by readers familiar with the paper. The general equations found in 
that paper for the derivation of the model are: 
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where qi is the frequency of strategy i, n the population size, K the carrying 
capacity (maximum environmental load, Hui 2006), Wi the fertility payoff func- 
tion of the i-th strategy, Sj the pre-reproductive mortality payoff function of the 
i-th strategy, Wb the background fertility, and b± background post-reproductive 
mortality and mortality-fertility trade-off function: 



and the equilibrium population size from ([2} is 
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A Hawk-Dove example was used to illustrate the above. This considered the 
payoff matrices S (mortality payoff) and F (fertility payoff) below 
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where s < 1 is the survival probability of a fight between Hawks, and the 
fertility matrix containing the expected number of newborns W produced in 
effect from the interaction. This led to the equations: 



q h = q h [{1 - —J (W b ( ei Sq T - qSq T ) + W (e x S • Pq T - qS ■ Pq T )) + bx{e x Sq T - qSq 1 
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and 

h = n [{qSq T W b + qS ■ Pq T W) (l - + qSq T h - l) , (5) 
where the matrix operations are as follows: 
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e 1 Sq T = aq h + l-q h = q h (s-l) + l, (6) 

ei S-Pq T = 0.5sq h + l-q h , (7) 

qSq T = q h (q h (s-l) + l) + (l-q h ) = l-q 2 h (l-s), (8) 

qS-Pq T = q h (0.5 S q h + l-q h ) + 0Ml-q h ) 2 = 0.5(l-q 2 h (l-s)).(9) 

After calculations and the substitution d = 1 — s the following equations 
were obtained 

q h = qh(l- q h ) ((l - (0.5VK (1 - g h d) - W b q h d) - b lQh d) , (10) 



h = n ((1 - ggd) + 0.5VK) (l " + 6i) - l) • (11) 

Two rest points of this system are qh = and 1. A nontrivial rest point, which 
becomes the attractor manifold for the density dependent case, (for detailed 
calculation see Argasinski and Broom (2012) is given by 

0.5 W ( 1 " 



Qh{n) = — \ K/ n v . (12) 

d((W b + 0.5W) (l — ) + 6i) 

There is a stable population size if either n — or the following positive 
restpoint which is conditional on the actual hawk strategy frequency (describing 
the attractor manifold parametrized by qh) 

The intersections of the above manifolds constitute the rest-points of the 
system. For the above Hawk-Dove game there are two intersections. If it exists, 
the first one is the stable mixed equilibrium which has the form 



2 ^ +i Kv( 2 T5M ,F - 4M(i - ,,i) 

* - 2M <"> 

and the second is an invasion barrier for a stable pure Hawk equilibrium 
(where qh converges to Hawk if and only if qh > qh)'- 
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3 Problems with background fitness 



In the (Argasinski and Broom 2012) to describe background mortality and fer- 
tility, a generalization of classical background fitness was applied to show the 
impact of the selectively neutral elements of the mortality and fertility payoff 
functions on the dynamics. There background fertility is some additive value 
Wb added to the fertility functions and background mortality is expressed as a 
multiplicative survival b\ = 1 — mi (index 1 was not in the original work, but is 
added here to distinguish this from our alternative approach introduced later) 
which is uniform for all strategies and does not affect the fertility. Since this 
mortality factor was modelled according to post-reproductive mortality com- 
bined with game-related pre-reproductive mortality, only game survivors are 
affected by b\ Thus both coefficients appear in the growth equations as additive 
factors si (l — W& + s,6i. In the replicator dynamics they appear inside the 
bracket of the right side of equation as an additive factor which has the form 
((l — -^) Wb + bi) (si — J2j 1j s j)- Thus, in the original equation where we have 
a single interaction rate t\, the background mortality component related to b\ 
is riSj(l — &i) = T\Sim\. This means that survivors of a game event suffer 
mortality mi which can be interpreted as the aggregated mortality between the 
contests. 

However, the question arises: is this approach correct? This structure sug- 
gests that background fertility and mortality acts directly after the contest and 
is a last part of a causal chain started by the game. Thus in Argasinski and 
Broom (2012), background fitness can be viewed as a simple adjustment to all 
of the payoffs arising out of a single interaction. This is conventionally how 
background fitness is incorporated in classical evolutionary games, where for 
static analysis and or replicator dynamics for simple matrix games the back- 
ground fitness has no effect, since only differences in payoffs matter. In such 
simple cases, this would also be the case if background fitness was regarded 
as coming from a separate source, since all individuals would again receive the 
same reward, and so no distinction is made between these two possibilities. As 
was shown in Argasinski and Broom (2012) background fitness can seriously 
affect the dynamics. Therefore the distinction between the two types of the 
background fitness became important. 

Especially from the point of view of the event based approach introduced 
in Argasinski and Broom (2012), background fitness should be rather the out- 
come of independent interactions not linked with a game. As was shown there 
all mating events can be lost due to pre-reproductive mortality, thus not only 
differences in fertilities but exact numbers of offspring should be analyzed in the 
models. Thus whilst background payoffs of the different type as discussed in 
Argasinski and Broom (2012) was a plausible way to first consider background 
fitness in our model, a more natural, and we would argue better, way is the one 
we shall use in this paper. 
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3.1 An alternative approach to background fitness based 
on the rate of event occurrence r 



The new approach is related to the methodology used for the separation of 
ecological equations from selection dynamics (Cressman and Garay 2003a and 
2003b, Cressman et al. 2001). However, we do not want to separate the ecolog- 
ical dynamics from the selection dynamics, since we believe that relationships 
between ecology and selection are extremely important. We want to separate 
the outcomes of a particular game from the outcomes of games of the other 
types. The effect of background fitness can be modelled more intuitively by dif- 
ferent types of events occurring at different rates (the rate of occurrence of the 
ith type of event will be labelled Tj) , which is a generalization of the approach 
presented in Appendix 1 of Argasinski and Broom (2012). 

We can consider multiple different types of events which occur as indepen- 
dent Poisson processes. This will allow us to remove survivors background fitness 
WbJ2i1i s i an d &i 9i s i from equations ([lj which will lead to the equations 
(|20|) described below. Individuals enter a game at rate t\, whilst they perform 
other activities at rate t 2 ; we can consider a single class of all such activities, 
as we show below. Assume that there are several types of background activities 
occurring at rate t 2 , and each of these events can be characterized by outcomes 
which include a fertility W£ and mortality b\ component. If the event of the ith 
type is a safe mating opportunity then the respective survival b\ equals one. On 
the other hand if the event is not related to mating or reproduction but is dan- 
gerous then W~l — 0. We can calculate the outcomes of the average background 
event. Wb = J2 i t 1 2 WI/t 2 is the average fertility per event (where t 2 = J2i T \) 
and b 2 = J2i T 2^h/ T 2 is the average survival probability per event (which can 
be called "parallel to game" mortality for distinction from post-reproductive 
mortality in the cause-effect chain). In effect "background events" occur at in- 
tensity t 2 and individuals involved in those events can obtain on average Wb 
fertility and survive with probability b 2 . Thus the general Malthusian equation 
will be: 



UiTiVi (l - - niTi{\ - Si) + niT 2 W b (l - -^rj - rnT 2 (l - b 2 ). (16) 



If Ti = t 2 then after change of the timescale t — tjr\ (see Appendix 1 of 
Argasinski and Broom, 2012) both of them vanish, if not then t\ vanishes and 

T 2 

t 2 transforms into 9 = — . Then the Malthusian equation will be: 

hi = [mOWb + mVil (l-jf) - n,-0(l - 6a) - n,-(l - *<) (17) 

(18) 



[0W b + Vi] [1 - —J - 9(1 - b 2 ) - (1 - Si ) 

As we see below in equation (f20|) . 9Wb and 9(1 — b 2 ) vanishe from replicator 
equations for the frequencies, thus in this case we obtain replicator equations 
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from the original paper ((T|) without background fitness (i.e. W& = and b\ = 1 
but they are present in the size equation: 



(1 - {ew b + J2 qmJ - 0(1 -h)-(i-J2 



(19) 



Parameters T2, VFb and hi can be biologically justified and can even be 
functions of other parameters (for example from other types of game). However, 
if we need only some background "noise" without particular justification, to add 
realism to our model, we can simplify the notation. Because parameters W b and 
62 never occur without the ratio between intensities 9, we can simplify this by 
substitution $ = 9W b and ^> = 9(1 — b 2 ) and we obtain the following system: 



1 - (Vi - J2 QjVj) + (si~Yl 



(20) 



1 - 



(21) 



K 



where equation (|2T|) follows directly from equation (|19[) . and equation ([20 
is obtained using equations (TT51) . (JTHJ) and the fact that qi = (rii/n) = (hin - 
nrii)/n 2 . The stable population size is given by 



which leads to 

n_ _ g + 1 - St g» s » 
while in Argasinski and Broom (2012) we have 



1 



(22) 



(23) 



1 = . (24) 

Thus the new approach presented above is somewhat simpler than the orig- 
inal equations. A question arises about the relationship between both ap- 
proaches. Is the original approach a simplified approximation of the more de- 
tailed new approach? 
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3.2 A comparison of the new approach with the approach 
from the previous paper 

Let us compare the general size equations using the different approaches to the 
background mortality, where b\ is the approach used in Argasinski and Broom 
(2012) and 62 is the new approach from the section above. For the new approach 
we have 

hi = n t V % (l - |p) - m(l - Si) - nrf (1 - 6a) (25) 
whereas the equation for the original approach was 

hi = riiVi (l - -^J - m(l - Si) - riiSi(l - h). (26) 

Thus the decay rates constituted by mortality terms in equations (|25[) and 
(|26l) are 

E 1 = -(l- Sl )-y (27) 

for the new approach, and 

E 2 = -(1 - Si) - sum (28) 

for the original approach, where mi = 1 — bi and = Bm-i = 0(1 — b^). Thus 
equality of the decay rates of both approaches E\ = E2 implies the condition 

Sirrii = 9rri2 (29) 

which cannot be satisfied for every i. Now, let us focus on the relationship 
between both approaches. They are certainly not equivalent, however we are 
interested in when the approaches are compatible. 

3.2.1 When are both approaches compatible? 

Relationship ([29]) cannot be satisfied in most of the cases, but other methods 
can be applied to show conditions when the original approach can be treated as 
an approximation of the more detailed new approach. Suppose that the game 
interaction happens at rate t\ and background death events with rate v (during 
that event an individual dies with probability 1). Setting 7 — v/t\ using the 

basic properties of the Poisson process, the survival probability is b\ = 

1 + 7 

since survival occurs if a new contest comes before death. It is easy to show that 
both approaches are not compatible in the general case. But under assumption 
of ecological equilibrium (stable population size) some relationships between 
first approach as the approximation of the second approach to the background 
mortality can be derived. They are summarized by following theorem 
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Theorem 1 

1 * 

If we assume that b\ = (or respectively mi = ) and the population 

size equilibrium condition (|23[) is satisfied then: 

a. The stationary frequency points for both approaches are the same. 

b. The rate of the dynamics in the first approach equals the rate of the 
second approach divided by 1 + 

c. The stationary population sizes are different, with the value of (l — j|) 
in the first approach equalling that of (l — 4|) / (1 + VP) in the second approach 

For a proof see Appendix 1. 

Thus it is possible to approximate independent background mortality by 
post-reproductive mortality related to the game event, describing the aggregated 
mortality caused by independent background events occurring between game 
interactions. The question arise about usefulness of this method. This will be 
shown in section 5 by Hawk-Dove game example. 



4 Selectively neutral density dependence and the 
concept of the eco- evolutionary feedbacks. 

Now let us focus on the impact of selectively neutral density dependence act- 
ing as juvenile mortality. The Hawk-Dove example presented in Argasinski and 
Broom (2012) is a case where there is a single equation on strategy frequen- 
cies, and the space of the population composition is the unit interval. We are 
interested in the rest points of the system and their stability. Since we have a 
system of two equations, one on q and one on n, we can expect two stationary 
manifolds obtained by calculation of the zero points of the equations. 

Argasinski and Broom (2012) contains the derivation of both stable mani- 
folds q(n), and n(q) (described more fully below) for the Hawk-Dove example, 
and the calculation of their intersections. However, a rigorous stability analysis 
is limited to the case when the system is in ecological equilibrium (Theorem 
2 of that paper). In this section the general result will be provided for games 
with two strategies. We can imagine more complicated two-strategy systems 
with multiple frequency dependent mortality and fertility stages (see section 3 
in Argasinski and Broom, 2012), but all of them can be presented in the general 
form 

q = q((l-^)w 1 (q)-M 1 (q)), (30) 

h = n(Wa{q)(l-^)-M 3 {q) y j, (31) 

where W\(q) = Wi — W and M\{q) = rrii — M describe the frequency de- 
pendent functions from the bracketed terms, while Wi{q) > and M2(q) > 0, 
since fecundities and mortalities are always non-negative. It is possible that 
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there exist stable manifolds q(n) and n(q) defined as follows. Expressing q as a 
function of n, the stable manifold q(n) is defined by the value of q for which the 
right-hand side of equation ([50)1 is for any given n (it is possible that there is 
more than one such solution, and so more than one such manifold). Similarly, 
expressing n as a function of q, the stable manifold n(q) is defined by the value 
of n for which the right-hand side of equation (f5T|) is for any given q. 

Now consider the phase space qx n, consisting of all possible values of q and 
n. On the manifolds q(n) and n(q) the right-hand side of the equations (|30l) 
and (J2J) respectively equals zero, and these manifolds divides the phase space 
into regions of growth and decline for q and n. When the right-hand side of 
equation (f3U)) is negative we have that q(n) > q (n) is the region of decline for 

q- 

We note that in the method presented in Argasinski and Broom (2012), the 
stable population size h(q) was substituted into the right hand side of equation 
(|50|) . Substitution of h(q) into q{n) leads to the inequatility q < (>)q(h) de- 
scribing the regions of growth (decline) of q lying on the stable size manifold 
h(q). In Argasinski and Broom (2012) the inequality q < q(h) has the form 
of a quadratic equation. Zeros of this equation are intersections of the stable 
size and stable frequency manifolds. Thus under the assumption of ecological 
equilibrium, this method shows which intersection is stable and unstable. This 
is a rigorous analysis but it is strictly limited to the stable density manifold. 
Below, by application of standard linearization methods we will show that those 
characteristics can be extended to the neighbourhood of the stable density man- 
ifold: 

Theorem 2 If for the system described by equations (f30]) and ([3"Tjl. stable 
manifolds q(n) and h(q) exist, then any intersection of the manifolds is an equi- 
librium point, where: 

a) if this equilibrium is unstable on the stable size manifold then it is unsta- 
ble. 

b) if this equilibrium is stable on stable size manifold then it is a local 
attractor if and only if the stable frequency manifold's slope is not sufficiently 
steeply declining in the direction of the strategy favoured by high population 
size. 

For a proof see Appendix 2. 

Thus we can mechanistically interpreted the stable and unstable intersections 
in terms of eco-evolutioary feedback ( Post and Palkovacs 2009, Kokko and 
Lopez-Sepulcre 2007). In the game theoretic framework this concept can be 
found in Argasinski and Kozlowski (2008), Zhang and Hui (2011) and Argasinski 
and Broom (2012). Let us denote the stationary frequencies of the system 
(which are the frequencies at the intersections of the manifolds q{n) and n(q)) 
here by q s tat- Perturbation in q induces convergence towards the respective 
stable size n(q pert ) lying on the stable density manifold n(q) which determines 
the respective frequency attractor q(n(q P ert)) on the stable frequency manifold 



12 



q(n). If \q{n{q P ert)) - q s tat\ < \q P ert - q s tat\ then negative feedback is induced in 
a sense that dynamics chase q{n(q per t)) towards q s t a t- In effect q s tat is stable. 
On the other hand, if \q{n(q pert )) — q s tat\ > \q P ert — qstat\ then a positive feedback 
is induced and the attractor escapes from q s tat- In effect q s tat is unstable. See 
Figure 1 for an illustration. The above general notions can be applied in our 
Hawk-Dove example, as we show below. 



4.1 Formulation of the updated Hawk-Dove game exam- 
ple 

We now illustrate the general concepts from the sections above illustrated with 
the example of the Hawk-Dove game. The frequency equations will be the same 
as (TT0)) with Wb = and b\ = 1, but the size equation will be different because 
the terms $ (l - and -0(1 - b 2 ) (-*) should be added. This will lead to 
the application of the system (|2"U)) and (j2"Tj) and the payoff functions derived 
from Hawk-Dove game matrices S and P. The system will have the form: 



Qh = qh ((l - -|) W (etS ■ Pq T - qS ■ Pq T ) + (e l Sq T - qSq T )) (32) 

h = n((<f> + qS- Pq T W) (l - + qSq T - 1 - . (33) 

After substitution of (I6I7I8I9I) and respective calculations and auxiliary sub- 
stitution d — 1 — s we obtain: 

q h = qh (1 - q h ) (o.5W (1 - q h d) (l - - q h dj , (34) 

n = »(($+ (1 - qld) Q.hW) (l - ^) - ^ d _ vp) . (35) 
Note that without background fertility Wb the above system collapses to: 

q h = q h (l- q h ) (0-5W (1 - q h d) (l - ^) - g fc d) , (36) 

n = n ((1 - q\d) (o.5W (l - + l) - 1 - . (37) 

In Argasinski and Broom (2012) the above system was simplified using the 
assumption that equation (|37[) is in the equilibrium and that evolution of the 
system is limited to be on the stable density manifold. Therefore, we can simplify 
also the new system by substitution of the equilibrium of (|3T[) which is 

U{qh) =K { 1 - 0.5W(l~qld) ) (38) 
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to the logistic suppression coefficient in (f31)|) which leads to 



4.2 Relationships between new formulation of the Hawk- 
Dove example and the previous paper. 

Following the previous section and considering background fertility Wb, the 
approach from Argasinski and Broom (2012) and the new approach are not 
compatible and the new approach is more realistic, general and mathematically 
simple. Let us now consider the problem of the background mortality which 
is a bit more complicated. For simplicity we remove background fertility with 
the assumption that Wb = 0. Thus equations (fTU|) and (|TT|) for the Hawk-Dove 
model become: 

q h = qh (1 - qh) (o.5VK (1 - q h d) (l - - hq h dj , (40) 

n = n ((1 - q 2 h d) (o.5W (l - + h) - l) . (41) 

In the previous sections it was shown that the new system (|34I35[) will pro- 
duce different trajectories to the model from the previous paper relating to 
(|40I41[) . However, after substitution of the equilibrium population size (|13[) to 
limit the system to the stable density manifold, we obtain the equation: 

q h = qh(l- qh) f (1 - qhd) ( ^~^^J^ J - biqtd^j (42) 
and the respective population size: 

As was shown in Theorem 1 in this case the system (|42|43j) can be regarded as 
a biased approximation of the new system 081391) . Then b\ « (or 

1 + 0(1 — 02) 

m-i ~ ). However, the obtained equations are not simpler. The removal of 

1 + * . 

9 under assumption of stable population size seems not to be profitable because 
frequency conditions will be more complex (6i instead of 1). 
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5 Numerical examples and their analysis 



This section contains numerical simulations of the updated Hawk-Dove game 
(|34I35|) to show the dynamics induced by the eco-evolutionary feedback mech- 
anism. For simplicity we remove the background fertility In Theorem 2 the 
local stability of intersections of the stable manifolds was proved. However the 
trajectories of the population away from this intersection prior to convergence 
are also interesting and will have ecological interpretations. In Argasinski and 
Broom (2012) numerical simulations showed the interplay between selection dy- 
namics and the dynamics of the population size. It was shown that ecological 
dynamics can seriously affect the rules of the game while frequency dynamics 
determine the population size. This was mechanistically explained in this pa- 
per by the phenomenon of the eco-evolutionary feedback. In this section we 
will focus on the relationship between the trajectories, population size and the 
geometry of the stable manifolds q(n) and h(q), to reveal new details of this 
process which were not shown in Argasinski and Broom (2012). 



5.1 Phase portraits of the dynamics 

In Argasinski and Broom (2012) results of the numerical simulations empha- 
sized the role of the intersections of both manifolds. In this paper we want 
to show the trajectories prior to convergence. To emphasize the role of both 
manifolds, in Figures 2-4, model parameters are chosen to set both intersections 
at values of frequencies q close to and 1. This allows us to maximize the area 
limited by both manifolds which are very close to each other in the cases when 
intersections are relatively close (see for example Figure 5). Some of the numer- 
ical simulations support the intuition that the dynamics converge to the close 
neighbourhood of the stable density surface and then trace the equilibrium size 
value (Fig. 2). In this case the assumption from Argasinski and Broom (2012) 
of the population taking the stable size for given frequency is justified. How- 
ever, this happens when both manifolds are placed at relatively high densities. 
At lower densities the trajectory does not reach a strict neighbourhood of the 
stable density surface (Fig. 3). At very low densities the trajectory converges 
closer to the stable frequency manifold (Fig 4) . We note that this effect is sup- 
pressed with population growth. In some cases the trajectory converges to the 
close neighbourhood of the stable frequency manifold and traces it nearly to 
the equilibrium (Fig. 5). Thus, the assumption that frequency selection occurs 
on the stable density surface can sometimes be seriously wrong. In the general 
case the geometry of both manifolds plays an important role in the dynamics 
and what happens in the region limited by those surfaces is crucial. At higher 
densities there is a stronger convergence toward the stable density surface while 
at lower densities there is a stronger attraction toward the stable frequency 
manifold. Therefore, the ecological equilibrium assumption is a simplification 
of the entire problem, sometimes with results clearly different to those of the 
general model. The differences between both approaches will be analyzed in the 
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next section. 



5.2 Comparison of examples with and without assumption 
of the stable population size starting from the same 
initial conditions. 

The stable population size assumption can be very strong. Figures 6 and 7 
show a comparison of the trajectories of the general and simplified models. The 
main difference is that the rate of convergence is accelerated in the simplified 
model. Another important difference is that in the general model the density 
dynamics does not "trace" the equilibrium value, but rather "chases" it. This 
is reasonable, because ecological equilibrium implies zero growth rate, which 
is in contradiction with the rapid growth of the population size shown by the 
trajectory. Thus in the general model there is inertia which is suppressed in the 
simplified model where density dynamics is forced to trace the equilibrium con- 
ditional on the current population composition. Figure 7 shows the dynamics 
of extinction. In the general model frequency dynamics follows the stable fre- 
quency manifold due to very low densities, while in the simplified model, again, 
the trajectory is forced to trace the stable density surface. 

Another interesting aspect is shown by the density dynamics in both vari- 
ants. In the general model the rate of population decline significantly decreases 
with the population size (the distance from the stable density surface increases) 
and smoothly converges to the restpoint 0. In the simplified model the trajec- 
tory stabs through the level and takes negative values, since it is constrained to 
follow the stable density surface, and this assumption becomes increasingly un- 
reasonable as the level is approached (clearly equation (pITj) can yield negative 
values for some parameters are values of qh)- This shows that in the simplified 
model the density dynamics is biased. Comparing both approaches, in the sim- 
plified system only the bracket describing the average per capita growth rate is 
taken into consideration instead of the overall dynamics. In addition, the chosen 
population size should zero this bracket, which is also an unrealistic assumption. 
However, as was shown by numerical examples, at high densities, the trajectory 
can nearly trace the equilibrium. Thus this method is a simplified approxi- 
mation appropriate under certain conditions, not necessarily the limitation of 
initial values equivalent to the general model. 



6 Discussion 

Results presented in this paper show the importance of two selectively neutral 
factors: background fitness and neutral density dependence in the selection 
dynamics. 
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Background fitness is the first factor that affects the outcomes of the model, 
and should be realistically modelled. The natural approach is to use the different 
interaction rates (intensities) describing fractions of individuals involved in game 
interactions and some particular type of background event resulting in additional 
fertility and mortality. This new approach is more realistic and provides an 
easier mechanistic interpretation than the method used in Argasinski and Broom 
(2012), which was inspired by the traditional approach to background fitness. 
The selectively neutral elements of the payoff functions are good tools to model 
the factors linked with the particular game event, which is clearly shown by 
the example of the density dependent juvenile mortality. However, background 
events should be described in the dynamics by different intensities and their 
own specific neutral "payoff" functions. 

Using neutral density dependence, the results introduced in Argasinski and 
Broom (2012) have been clarified and improved. We have proved that claims on 
the local stability of the manifold intersections on the stable density surface can 
be extended to the neighbourhood of that surface. In effect, the general method 
of finding intersections of stable manifolds has been mathematically justified and 
generalized. The phenomenon of stability and instability of the intersections 
was mechanistically explained by the concept of eco-evolutionary feedbacks. 
The stability or instability of the particular stationary frequency is caused by a 
shift of the frequency attractor conditional on a corresponding correction of the 
density attractor. This density attractor is conditional on the perturbation of 
the frequency, which closes the feedback loop. The new approach is related to 
current development in evolutionary theory focused on relationships of selection 
processes with ecological factors (Schoener 2011, Morris 2011, Pelletier.et al. 
2009). 

Numerical simulations show a variety of behaviours. Some of these are 
against intuition based upon the dynamics concentrated on frequencies occur- 
ring on the stable density manifold. At low densities there is a stronger attrac- 
tion towards the stable frequency manifold. This is caused by the fact that at 
high densities differences in fertility are suppressed by density dependent ju- 
venile mortality described by the logistic suppression coefficient, while at low 
densities the impact of fertility on the overall dynamics is significant. Thus both 
manifolds are important for the dynamics. 

There are possible simplifications of the general model used in Argasinski and 
Broom (2012). One simplification relies in the reduction of the dimension of the 
problem by substituting the population size equation by its equilibrium value. 
However, results from this paper, especially numerical simulations, clearly show 
that this is. A simplified approximation of the general model which is seriously 
biased unless the population is at relatively high densities. Under the assump- 
tion of ecological equilibrium, background mortality can be approximated by a 
game interaction related post-reproductive mortality describing the aggregated 
background mortality between game interactions. In effect rates of occurrence 
(intensities) can be removed from the equations. However, it is not useful for 
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the dynamic models, because the equations obtained are more complex than 
before and their trajectories are seriously altered. Only restpoints are com- 
patible. Also the interpretation of the background mortality described as the 
post-reproductive mortality is problematic in the dynamic context. 

However, it does not mean that this approach is completely useless. If we 
are not interested in explicit modelling of the dynamics but interested only in 
the restpoints, the original approach is more natural because the underlying 
strategic reasoning is expressed in terms of outcomes of some events measured 
as fertilities and mortalities instead of the abstract rates such as Thus the 
approximation of the background mortality from the original approach can be 
useful in static analysis which is equivalent to finding zeros of the right sides of 
the replicator equations. 

The project is realized under grant Marie Curie Grant PIEF-GA-2009-253845. 
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Appendix 1 

Proof of theorem 1: 

a) and b) The replicator equations of the original approach (Argasinski 
Broom 2012) are given by 



9i = Qi[ qjVj I (l - + h( Si - ]T q jSj ) ] (44) 

3 I 3 



and for Wb = (equation |24|) we have the form 



K 



(45) 



After substitution of the population size equilibrium J^5[ ) to we have: 
« = » ^ U - E *V?J 1 ~£^y* ai + b ^ ~ E Wi) j ( 46 ) 



and after substitution of b\ — — we have 

1 + * 



^i^((^-E^)i±i^ + ( S ,-i:^)). <«> 
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Thus &i affects only the rate of convergence and manifold intersections will 
be the same as in the new method presented in this paper. 

c) Application of this approach leads to following differences: 
stable sizes: 



1 -^_+ # 

Vi 



1 — -S) = for the new approach 



(l — = - — tj— f° r the original approach. 
After substitution of bi = — — — we have: 



l + m-6a 



1 Si 



(-1 _ n_\ _ 1 + _ 1 ~ Si + g _ 1-Sj + V 

[ k) ^ [i + 9)Vi~ v 0l - 

The difference is that denominator of logistic bracket is multiplied by (1 + 1 J r ). 



Appendix 2 

Proof of theorem 2: 

We can present our system in the form: 



f{n ' q) = Tt= n ( W2{q) i 1 -^)- M2(q) ) ' (48) 

g(n,q) = J = q (Wi(q) (l - - Mi(?)) (49) 

g(n, q) = ^ = q(l- q) (w 3 (q) (l - - M 3 (?)) , (50) 

where W 2 (ff) > 0,M 2 (ff) > 0, W 3 (g) = Wi(?)/(l-g) andA/ 3 (g) = Afi(g)/(1-?). 
The fact that equation (|49p can be written in the form of equation can be 

seen by noting that ^| = — d ^7^ , which can also be written in analogous form 
with a factor of (1 — q). 

Standard linearization techniques can be applied. At the critical points ra, q 
we have f(n, q) = g(h, q) = 0. We need to consider each of the derivatives of / 
and g with respect to each of q and n at the critical points, and in particular 
the Jacobian matrix 

f fn{n,q) f q (n,q) \ 

\ g n {n,q) g q {n,q) J 
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K 



-Mi 



and its eigenvalues. 
The derivatives are 

f n (n,q)=W 2 (q) (l - - M 2 (g) - „ 
/ 9 (n, <Z ) = n(^ 2 / ( <Z ) (l--|)-M 2 / ( g )) 

, x (i-g)gw 3 (g) 

9n{n, q) = — 

g q (n,q) = (l-2q) (w 3 (q) (l - - M 3 (qj)+q(l-q) (w/fa) (l - 

where W((q) is the derivative of W,(g) w.r.t q, and similarly m( (q) is the 
derivative of Mi(q) w.r.t g, for i = 1,2, 3. 

After substitution of the stationary points we have 
Waff?) 

/ n (a,$) = -n-|p<o 

f q (n,q)=n(w/(q)(l-^)-Ml(q)) 

q(l-q)W 3 (q) 
9n(n, q) = — < 

g q (n, q) = q(l - q) (w'{q) (l - ^) - M((q)) . 

The eigenvalues of the Jacobian are found as follows. 

\ 2 + AX + B (51) 
where A = -(f n (h,q) + g q {n,q)) and B = f n (h,q)g q (h,q) - f q (h,q)g n (n,q). 

Thus 

-A ± V^4 2 - 4B 
Ai,2 g 

For stability we need either two negative eigenvalues or two complex eigen- 
values with negative real parts. This occurs when A > and B > 0. 
B > if 

fg(n,q) g q (n,q) 
fn(n,q) g n (n,q) 

which is equivalent to 

dh(q) dn*{q) 
dq dq 

where ri* (q) expresses the stable frequency manifold in terms of n as a function 
of q (this is possible as there is a 1-1 correspondence between n and q, at least 
in the vicinity of a root). For example in Figure 3 we see that the slope of the 
stable density manifold with respect to q is less than that of the stable frequency 
manifold at the first root (both are negative and the former is declining more 
quickly), so that this root is unstable. At the second root the order of the 
derivatives is reversed, so that the root may be (and in fact is, see below) 
stable. 



fn(n,q)-X fq(n,q) 
9n(n,q) 9g(n,q)-X 
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The second condition for stability is A > 0. This occurs if f n (h,q) + 
g q (h, q) < 0. The first of these two terms is negative; the second of these being 
negative is the condition for stability of frequency independent models. Thus, 
for example, the Hawk-Dove game which has a mixed ESS for its frequency- 
independent version (the classical game) automatically satisfies this condition. 

In general, for our model 

/ n (n, q) + 9q (n, q) < => < (>)MM) (52 ) 

9n{n,q) g n {n,q) 

dri*(q) , . nW 2 (q) , . 

"dT > (<) " WW (53) 

if g n (n,q) is negative (positive), i.e. if W\(q) is positive (negative). Thus the 
stable frequency manifold's slope is not sufficiently steeply declining in the di- 
rection of the strategy favoured by high population size. 

Now let us compare this solution with the case from Argasinski and Broom 
(2012) where the population size was assumed to take its equilibrium value. 
This means that equation (|4"gj) is set to 0, giving equation (|4"5)) as 

-*(,)). (54, 

Differentiating with respect to q at an equilibrium value q will give stability 
within the manifold if and only if the derivative is negative. Thus such a root 
is stable if 

( w({q)M 2 {q) WM^UqWljq) W^M^q) / \ 

q \^m + W 2 (q) - A/ i(9)j<0 (55) 

at q = q. At equilibrium the first main bracketed term is zero, and pairing the 
first two terms and the last two terms from the second main bracket leads to 

q]]]iq) f q (n,q)+g q (n,q)<0^ (56) 



nW 2 (q) 
9n(n,q) 



f g (n,q)+g q (n,q) < (57) 



fn{n,q)' 

which is identical to B > since f n (n,q) < 0. 

Thus any solution using the stable population size assumption of Argasinski 
and Broom (2012) which is unstable is automatically unstable in the vicinity 
of the root for the general game, and any solution that is stable under that 
assumption is stable provided that the slope of the frequency manifold satisfies 
the stated extra condition. 

end of the proof 
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Symbol 
~W b 

Qh(n) 
m - 

n(lh) 
K 

Tl 

n 
Qi 

mi = 1 — bi 

Vi = T,i<ij s i( e j) w i( e j) 



s 

* = 6>(1 — 6 2 ) 
F = WP 
E 2 

d = l-s 
Ex 



Meaning 

background fertility (number of offspring) 
stable frequency manifold 
background post-reproductive mortality 
stable density manifold 

carrying capacity (maximal environmental load) 
rate of occurence (intensity) of the game event 
population size 

rate of occurence of the background event 
frequency of the i-th strategy 

background mortality of Argasinski and Broom (2012) 
mortality-fertility trade-off function 
- II 

survival probability of the i-th strategy 
rate of the average background fertility 
mortality payoff matrix 
rate of the background mortality 
fertility payoff matrix 

decay rate from Argasinski and Broom (2012) 

probability of death 

decay rate of the new approach 



Table 1: Table 1: List of important symbols 
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FIGURE CAPTIONS 

Figurel Presentation of the eco-evolutionary feedback mechanism. Positive 
or negative feedback is induced by the position of the density and frequency at- 
tractors n(q pert ) and q(n(q pert )) towards the stationary point (intersection) q s t a t- 
Note that we consider a continuous system and not a sequential discrete system, 
and this figure is an illustration only. Other figures show that at relatively high 
densities attraction towards the stable density manifold is much stronger than 
attraction towards the stable frequency manifold. 

Figure 2 Initial conditions %(0) = 0.2 and n(0) = 147. Model parameters: 
W = 7, d = 0.5, ^ = 0.01. The trajectory converges to the very close neigh- 
bourhood of the stable density surface and follows it converging to the mixed 
equilibrium q\ = 0.0202. The Hawk invasion barrier is q\ = 0.9897. Thus in 
a stable mixed equilibrium there is approximately one Hawk per 50 Doves and 
Hawks can invade a population if their number exceeds 100 per single Dove. 

Figure 3 Initial conditions ^(O) = 0.6 and n(0) = 147. Model parameters: 
W = 7, d = 0.8, # = 0.06. At lower densities convergence to the stable 
density surface is not strong. The stable frequency manifold is passed by the 
trajectory. The mixed equilibrium is q\ = 0.0762, while the Hawk invasion 
barrier is = 0.9837 is still small. 

Figure 4 Initial conditions qh(0) = 0.89 and n(0) = 147. Model parameters: 
W = 0.8, d = 0.5, # = 0.01. In this case, at the beginning the trajectory 
passes the stable density surface and converges to the neighbourhood of the 
stable frequency surface, but then the trajectory leaves it slowly converging to 
the density surface. The mixed equilibrium is q\ = 0.0202, while the Hawk 
invasion barrier is q^ = 0.9897. 

Figure 5 Initial conditions %(0) = 0.2 and n(0) = 20. Model parameters: 
W = 3, d = 0.9, * = 0.4. In this case the trajectory converges to the very 
close neighbourhood of the stable frequency surface and follows it almost to the 
mixed equilibrium q^ — 0.4865. The Hawk invasion barrier is q\ — 0.9134. 

Figure 6 Initial conditions g^(0) = 0.89 and n(0) = 271/. Model parameters: 
W = 1.6, d = 0.5, * = 0.08. 

Figure 7 Initial conditions qh(0) — 0.89 and n(0) = 2717/- Model parameters: 
W = 7, d = 0.8, # = 0.3. 
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a) general model 
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b) system in ecological equilibrium 
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b) system in ecological equilibrium 
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